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Abstract 

This paper studies a stylized model of local interaction where agents choose from an 
ever increasing set of vertically ranked actions, e.g. technologies. The driving forces of 
the model are infrequent upward shifts ("updates"), followed by a rapid process of local 
imitation ( "diffusion" ) . Our main focus is on the regularities displayed by the long-run 
distribution of diffusion waves and their implication on the performance of the system. By 
integrating analytical techniques and numerical simulations, we come to the following two 
main conclusions. (1) If dis-coordination costs are sufficiently high, the system behaves 
critically, in the sense customarily used in physics. (2) The performance of the system is 
optimal at the frontier of the critical region. Heuristically, this may be interpreted as an 
indication that (performance-sensitive) evolutionary forces induce the system to be placed 
"at the edge of order and chaos" . 
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1 Introduction 



Social and economic change typically comes in "waves" or "avalanches" with seemingly little 
intertemporal structure. Its complex dynamics are partly a result of the following two features: 
(a) the stimulus for change spreads throughout the population by cumulative local interaction 
channeled along a social network; (b) the payoff incentives that govern individual behavior are 
subject to considerations of (local) compatibility and/or coordination with neighbors. In this 
paper, we focus on a simple model displaying these two features. To fix ideas, we shall often 
propose a technological interpretation of the model and conceive its dynamics as an unbounded 
process of technological change. Its motion may then be seen as fueled by two forces: (i) 
infrequent upward perturbations, which are payoff independent and will be simply referred to as 
"updates"; (ii) relatively rapid payoff-responsive adjustment, which will be know as "diffusion". 
Thus, for the sake of focus, we study a context where diffusion is the only purposeful activity, 
reacting to a stochastic process of gradual "invention" that is fully exogenous. 

In our stylized framework, it turns out that different technological scenarios can be solely 
characterized by the value of a certain cost related parameter k £ R+. This parameter reflects 
the relative costs of upward versus lower dis-coordination with neighbors, higher values of k 
indicating a situation where the former costs are relatively larger than the latter. In this con- 
text, our main conclusions can be summarized as follows. First, we find that there is a certain 
threshold for k which (roughly) separates the region where the population evolves in almost 
perfect coordination from the region where a wide range of technological heterogeneity tends to 
persist over time. Moreover, within the latter region, the system behaves in a critical manner, 
the concept of criticality being understood here as in modern physics (Bak et al. (1987)). In 
particular, it refers to the fact that the distribution over "avalanche sizes" (i.e. the range of dif- 
fusion waves) generated by the recurrent updates obeys a power law. This fact has interesting 
theoretical implications. For example, it indicates that the system displays no characteristic 
scales (or magnitudes), the trade-off between avalanche size and its corresponding empirical 

frequency remaining constant throughout (in terms of proportional changes) But perhaps 

1 Such a constant tradeoff can also be understood as an indication that local stimuli have a relatively large 
(i.e. non-local) range of influence. (For example, this would not occur if the decay of avalanche frequency with 
respect to size were exponential.) Traditionally, it was thought that physical environments had to be accurately 
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more importantly for our present purposes, another useful implication of criticality pertains 
to the extreme simplicity displayed by long-run aggregate behavior under those circumstances. 
Such simplicity will render it tractable to carry an analytical study of the model, thus shedding 
light on some important issues. In particular, our main focus here will be on how the long-run 
performance of the system depends on k, the key parameter of the model. 

In this latter respect, our main conclusion is quite stark: under some natural measure of 
"performance" (see later for details), the behavior of the system is optimized within a rather 
thin region for k where the system has already abandoned the synchronization region (a region 
that physicists often call supercritical) and has barely entered the critical region. Borrowing a 
well-known phrase of Kauffman (1993), we may interpret this conclusion as a tangible embod- 
iment of the tenet that many dynamical systems have their performance optimized at the thin 
"edge of order and chaos" . 

The reason why some heterogeneity must be conducive to better performance is not difficult 
to comprehend: only if some inter-agent differences arise along the process may diffusion have 
a significant role to play. However, to understand why optimality should be attained at the 
"brink" where such heterogeneity is about to recede is a quite more subtle issue. In essence, 
we shall find it to be a consequence of the following intriguing feature displayed by critical 
behavior: across different avalanche sizes and values of k, there is a constant (proportional) 
effect of avalanche size on the induced technological advance. 

In this paper, our approach to studying these phenomena relies on a synergic use of both 
numerical simulations and analytical techniques. On the one hand, we resort to numerical 
simulations to obtain some regularities (e.g. the verification of power laws) on which to build 
our ensuing formal analysis. This analysis is then used to gain a theoretical understanding of 
some of the key conclusions also obtained from numerical simulations (e.g. those concerning 
the optimal performance of the system). Overall, it is such a "symbiosis" of mathematical 
analysis and numerical results that will provide us with most of the insights obtained on a 
dynamical system that, because of its huge complexity, would be hardly tractable otherwise 
(e.g. by an exclusive use of analytical techniques). 

This paper owes much of its original inspiration to the booming literature on self-organized 
criticality developed in physics over the last decade. (The seminal articles are Bak et al. (1987) 
and Bak et al. (1988), whereas a good recent survey can be found in the monograph by Jensen 

tuned to some critical state in order to obtain such long-range effects. Since the work of Bak et al. (1987), such 
criticality is known to be attainable without any external fine-tuning (i.e. through self-organization). 
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(1998).) This field of research started with the study of simple sandpile-like setups, where many 
of the essential ideas and insights first originated. Subsequently, there has been a wide variety 
of different contexts (biological evolution, the time pattern of earthquakes, the functioning of 
the brain, the dynamics of traffic jams, etc.) where simple adjustment rules have been seen to 
generate self-organized critical behavior (see Bak (1996) for an informal survey of applications). 
More in line with our present concerns, critical behavior has also been observed in the way 
"information" diffuses through social systems. For example, Redner (1998) has showed that the 
"waves" of academic quotation display power distributions, and similar conclusions have been 
found for how connections are distributed in the internet (Faloutsos et al. (1999)) or in the 
World-Wide Web (Albert et al. (1999) or Huberman and Adamic (1999)). In economics and 
game theory, these ideas have received only little attention. However, they have been applied 
to the study of business cycles by Scheinkman and Woodford (1994), economic geography 
by Krugman (1996), or games displaying strategic substitutabilities (i.e. "anti-coordination" 
games) by Agliardi (1998, Chapter 6). Our essential change of focus over this work is that our 
objective here is not only positive (describing long-run regularities of complex dynamic systems) 
but also normative, i.e. linking the particular form of these regularities to the performance of 
the system. In spirit, therefore, our perspective is quite akin to that held by those researchers 
(see Arthur et al. (1997) for a wide collection of representative work) whose objective has 
been to understand the interplay between complexity and performance in large socio-economic 
systems. This is also the concern of a previous paper of ours (Arenas et al. (2000)), where 
some preliminary results along these lines were originally reported. 

Our model has also borrowed some important features from the recent evolutionary litera- 
ture on learning in games, initiated by the seminal papers of Kandori, Mailath & Rob (1993) 
and Young (1993). In particular, we pursue the same methodology of integrating selection 
adjustment (here, myopic best response) with occasional perturbations. More specifically, the 
present model is akin to those of Blume (1993), Ellison (1993), or Young (1998) where, as in our 
case, a topology of local interaction is introduced and each agent is constrained to playing the 
game with her immediate neighbours. The game being played, on the other hand, bears some 
key similarities to the so-called minimum-effort game (see Bryant (1983), van Huyck, Battalio & 
Beil (1990) or Crawford (1991)), which has also been widely studied in the equilibrium-selection 
literature. Our approach, however, displays two essential differences with this literature: (i) the 
setup involves a "changing game" with a unbounded set of potential actions; (ii) the concern 
is not one of equilibrium selection but of dynamic performance. 
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In fact, it is precisely the ever-changing nature of the (coordination) game that allows us 
to interpret the dynamics induced as a process of technological change carried out under local 
complementarities (recall our former discussion). This then brings to mind two vast strands of 
related research: the literature concerned with so-called network externalities and that studying 
technological change and growth. We address each of them in turn. 

Network externalities have been a major field of study in the theory of industrial orga- 
nization at least since Farrell and Saloner (1985) and Katz and Shapiro (1985) wrote their 
seminal papers on the subject - see Economides (1996) for a recent survey. The primary aim 
of this literature has been to understand, from a strategic viewpoint, the considerations that 
might promote or deter technological adoption when the payoffs to it are directly dependent on 
the decisions of others; specifically, that is, on the number of other producers (or consumers) 
producing (or buying) the new good. 

On the other hand, concerning the relationship between technological change and economic 
growth, this issue has regained a central role in recent times due to the importance accorded 
to it by the so-called New Growth Theory. A good case in point is the Schumpeterian model 
of growth through "creative destruction" developed by Aghion and Howitt (1992), where in- 
novations (that improve the whole production activities in the economy) arrive stochastically 
through investment in R&D geared towards the enjoyment of (temporary) monopoly gains. 
This model was enriched by Grossman and Helpman (1991) by integrating the technological- 
ladder approach proposed by Aghion and Howitt with the multi-sectorial features of a model 
formulated by Sergestrom, Anant and Dinopoulos (1990). In such an enriched Schumpeterian 
model, technological ladders are climbed in each separate sector by specific R&D expenditures 
targeted to each of them. In every sector, therefore, a process of creative destruction unfolds, 
which forever pushes the economy's average technological level upwards over time. 

Heuristically, one could interpret our model as reflecting a stylized process of technological 
change that merges the Schumpeterian features displayed by the Grossman-Helpman approach 
with the technological complementarities studied by the aforementioned literature on network 
externalities. In contrast with the former, innovation is taken here to be purely random (i.e. 
not the outcome of purposeful and forward-looking agents). And, in contrast with the latter, 
the technological complementarities are studied dynamically, thus amounting to an unbounded 
process of technological growth through (purposeful, albeit myopic) diffusion. 

The rest of the paper is organized as follows. Section 2 describes the framework. Section 
3 presents the dynamics. Section 4 presents the numerical simulations: while its Subsection 
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4.1 focuses on the regularities displayed by the induced limit distributions, Subsection 4.2 
is concerned with identifying interesting conclusions regarding issues of self-organization and 
long-run performance. Section 5 pursues a task of synthesis. That is, it builds upon the 
regularities found in Subsection 4.1 to provide an analytical explanation for the results obtained 
in Subsection 4.2. Finally, Section 6 closes the paper with a summary and the discussion of 
some issues left for future research. 

2 The framework 

We consider n agents, each of them occupying a particular node in a one-dimensional boundari- 
less lattice (i.e. a ring). Time is discrete. At every t = 0, 1, 2, each agent i € N = {1, 2, n} 
adopts a certain action aj(t) £ R+ that, for concreteness, may be conceived as the technol- 
ogy level she currently uses. Every agent i is assumed to interact with the individual to the 
right and to the left of her. For simplicity, these neighbors are taken to be those agents with 
adjacent indices, i + 1 and i — 1, where and n + 1 are respectively interpreted as n and 1. 
Out of each of her two interactions, agent i obtains corresponding payoffs, ip(ai(t), aj+i(i)) and 
vp(a,i(t), aj_i(t)), where if) : R+ x R + — > R is a fixed and common payoff function. 
We shall postulate that the payoff function may be written in the following way: 

tp(a,a) = f(a) - g(a,a') (1) 

for some function / : M + — > M + which is unboundedly increasing (i.e. lim^oo f(a) = oo) and 
a function g : R + x K + — > R + which is bounded and satisfies: 

g(a,a')>Q&a^a'. (2) 

For any given action a G R + , /(a) may be viewed as the payoff ceiling for this action. In view 
of (||)-(|2|), this maximum payoff is attained in any given interaction with someone playing a' 
if, and only if, a = a'. Otherwise, there are some bounded "incompatibility costs" that detract 
from the base payoff. By way of illustration, we may think of every two neighboring agents 
as involved in the completion of a certain joint project, for which dissimilarity of actions (or 
technological levels) leads to some waste of resources. 

In general, the incompatibility costs incurred by any given agent may arise from two al- 
ternative sources: (i) the agent is too advanced relative to her neighbors; or (ii) she is too 
backwards. In either case, the induced effects may be of different significance. To account for 
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this possibility, we posit: 



g(a,a') 



71 (a' — a) if a' > a 

72 (a — a') if a > a' 



(3) 



where the functions 71,72 : K++ — > K++ reflect, respectively, the negative payoff consequences 
of being more or less (technologically) advanced than one's partner. For simplicity, these two 
functions will be taken to be "scaled symmetric counterparts" in the following sense: there are 
positive parameters k\ and k2 such that, for all x € 



Intuitively, the larger (smaller) is k\ as compared to &2 the more (less) detrimental it is to be 
more advanced than one's partner as opposed to being more backwards. As it turns out, only 
the difference k = k\ — &2 will play a relevant role in the analysis. 

Thus, heuristically, one may conceive the context described as reflecting a situation where 
every two neighboring agents, i and i + are involved in a coordination game that, if faced in 
isolation, would induce both of them to choosing the same action. Nevertheless, the key fea- 
ture of our approach is that every player i must choose a common action in each of the games 
she plays. Therefore, the games played by agent i with i — 1 and i + 1 are not independent, 
i.e. cannot be treated in isolation. This is precisely the assumption that renders the model 
interesting, and is akin to that posited by the received evolutionary literature concerned with 
equilibrium selection in coordination games (recall the Introduction). Unlike this literature, 
however, we contemplate an unbounded ladder of possible actions where players may coordi- 
nate. This provides the basis for the rich adjustment dynamics that will be seen to arise along 
the induced "ever-moving game" . A formal description of this dynamics is undertaken in the 
next subsection. 

3 The dynamics 

Within the basic framework just introduced, we posit an adjustment dynamics displaying the 
following two components: 

Diffusion: When receiving a revision opportunity, each agent i behaves "myopically" and adopts an 




(4) 



action that is a best response to what her neighbors are currently doing. Such a diffusion 
component of the process is taken to operate in a relatively fast manner. 
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Updates: Occasionally, an agent is subject to an exogenous perturbation (that may be conceived 
as an innovation) which shifts upward her action (technology level) by some randomly 
chosen amount. This component of the process is to be thought as relatively slow. 

For the sake of tractability, the diffusion and update processes are formally decoupled. That 
is, we postulate that the updates only perturb ("punctuate") the system when the diffusion has 
reached a standstill. Thus, in between any two consecutive updates, the process is supposed 
to have enough time to reach a point where no agent wants to revise her action any further. 
This is a convenient but extreme assumption made by the whole literature on self-organized 
criticality (recall the Introduction), since it allows for sharp definitions of the key notions of 
wave or avalanche (see below). However, the same long-run qualitative behavior of the model 
would be observed if the two dynamics (diffusion and updates) were genuinely integrated but 
the former happened to be much faster than the latter. In this sense, therefore, such less 
extreme situation can be seen as suitably approximated by a context where both dynamics are 
formally separated. 

Next, we describe precisely each of those two components of the dynamics: first the slow 
updates, then the fast diffusion. 

(i) Updates 

Updates are indexed by t = 1, 2, .... As explained, after any given update, there is a diffusion 
wave that must reach a standstill before the next update occurs. Denote by a(t) = [cij(t)]" =1 
the profile displayed by the population once the diffusion phase triggered by update t has come 
to a halt. Then, update t + 1 is taken to operate as follows. 

A single agent i(t + 1) is randomly chosen to have her technological level subject to an 
upward shift. Specifically, her new technological level becomes a t (t+i)(i) + o where a is a 
i.i.d. random variable, distributed on a finite interval [0, v ] according to some continuous 
density (p. These updates play the role of exogenous (i.e. unmodelled) perturbations that shift 
the technological level of a particular agent upwards. They may be provided with several 
motivations, e.g. payoff shocks or population renewal. However, our preferred interpretation 
is that of "innovation possibilities" arising in conjunction with "optimistic expectations". 

More specifically, we propose to view an update as embodying some new option/idea re- 
ceived by the agent in question that, when pursued, this agent optimistically expects to be 
followed by a sufficient upward adjustment by her neighbors. Notice that in view of the as- 
sumption that every update originates at an equilibrium state, there is a natural asymmetry 
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between upward and downward changes in this respect. That is, even if an agent were to receive 
exogenously the option of moving to a lower action (i.e. a downward update), she will never 
choose to do so if she believes that others would only react (if at all) in the same direction. 
For, in this case, whatever expectations she might hold on the pattern of adjustment that could 
ensue, she can only loose by adopting a downward update. 

As explained below (see (ii)), diffusion adjustments turn out to display the aforementioned 
monotonicity property, i.e. they always operate in the same direction as the update that 
triggers them. Thus, we may rely on the considerations just described to provide a heuristic 
motivation for an update as the combination of an innovation plus optimistic expectations. In 
this light, it is natural to assume that, once some optimistic expectations of this kind are in 
place, they should exhibit some persistence. That is, they need not be always downgraded (say, 
to static expectations^]) if the expected response fails to materialize in the ensuing avalanche. 
Otherwise, updates would generally prove to be an insufficient "fuel" for sustained advance, and 
our model would eventually become trapped in an uninteresting deadlock.^ For convenience, 
we shall introduce such persistence into the model quite starkly and simply assume that any 
player who undertakes an update towards some a(t) at any t never adjusts her level below a{t) 
thereafter. Formally, this is captured by defining, for each agent i and each t, a lower bound <r| 
on her adjustments that is given by the last former update experienced by this player. That 
is, the action level attained at that last update is assumed to act as a floor on player i's future 
adjustments (see below for details). 

(ii) Diffusion 

After agent i(t) has been perturbed at t, a diffusion (or adjustment) process ensues. Let 
us index the stages of this process by q = 0, 1, 2, ... and let a\{q) denote the action chosen by 
any agent % in stage q. With this notation in hand, the diffusion process may be described as 
follows. 

At q = 0, we have a*-(0) = a,j(t — 1) for j ^ i(t) and ar^JQ) = a^ t )(t — 1) + at, where 
at is the realization of the random variable a at t. Subsequently, at every q = 1,2,..., agents 

2 Static expectations (i.e. the belief that the actions currently adopted by others will remain in place next 
period) can be taken to underlie the myopic best-response dynamics posited below for the diffusion dynamics. 
Thus, in this light, an update can be regarded as an infrequent and "optimistic" deviation of this state of affairs. 

3 For example, in the specific context studied in Section ^, we find that if the process starts at an homogeneous 
profile no single update can produce a genuine avalanche (involving more than one agent) when k = ki — hi is 
above the threshold value of 3.164. Consequently, under these conditions, the process would not grow at all if 
the updates did not exhibit some persistence. 
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are randomly chosen to revise their action. Specifically, we postulate that any agent i £ N 
who receives an adjustment opportunity at stage q chooses an action a\{q) that maximizes 
(myopically) her payoffs under the following double constraint. On the one hand, she cannot 
surpass the current action ceiling prevailing in her own neighborhood. On the other hand, her 
new action cannot fall below the floor given by her last own update. The motivation for the 
first constraint is that any adjustment by player i which exceeds the maximum action level 
(3j(q — 1) = max{a* +1 (g — l),a*(q — l),a'_ 1 (g — 1)} should be conceived as an "innovation" 
and thus restricted to enter the system as an update.^ The motivation for the second was 
already explained above when introducing our formulation of updates. 

Formally, each agent i E N who receives a revision opportunity at q is taken to solve the 
following optimization problem: 

max [tf;(a,al +1 {q - 1)) +^{a,a t i _ 1 (q - 1))] 

(5) 

s.t. 4<a<f3\(q-l). 

The above problem determines whether the agent in question might be interested in revising 
her former action. Denote by A*(g) the set of solutions to the above problem, which is assumed 
non-empty (possibly including several actions, of which one may be the status-quo ct\(q — 1)). 
Furthermore, let = {i £ N : a\{q — 1) ^ A*(g)} stand for the set of agents whose prior 

action is not optimal. Then, if ^ 0, we choose at random one individual i E ^(q) and 

make: 

(a) a\(q) £ A*(g), any choice in A*(g) with equal probability; 

(b) a* (g) = a* (g — 1) for all other agents j ^ i. 

Once (a) and (b) have been implemented, the process enters stage q + 1. The payoff function 
ip(-) will be assumed to guarantee the following two- fold property (see (§) for an example) :[] 

(f) a\{q) > a\{q — 1) for all % and q; 

(I) there is some finite q at which there is no agent left in a position to revise her action, i.e. 
Z\q) = 0. 

4 Thus, implicitly, we suppose that new (technological) information only diffuses locally. We believe that this 
informational restriction can be substantially relaxed but have not yet conducted any detailed explorations of 
different alternatives. 

5 In general terms, if the ceiling-payoff function /(■) is increasing and weakly convex (e.g. linear) and the cost 
functions ji(-) are increasing and strictly concave, this is enough to ensure that the desired property holds. 
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Then, having reached the latter q, we make di(t) = a\(q). 

The concatenation of diffusion phases and updates defines the dynamical system under 
consideration. For each t, the adjustment process that restores stability after the corresponding 
update is called a (technological) avalanche, where we use the usual term coined in the physics 
literature for this phenomenon. We shall be interested in quantifying the size s(t) of each 
avalanche at t as follows: 

s(t)=#{i:a t (t)^ ai (t-l)}, (6) 

where stands for the cardinality of the set in question. We shall also concern ourselves 

with the total advance triggered by the avalanche, as given by: 

n 

-^(i-l)]. (7) 

8=1 

As explained next, our numerical simulations show that these magnitudes, s(-) and H(-), display 
interesting long-run regularities. 

4 Numerical analysis 

Given the large dynamic complexity of our model, some of its key features have been determined 
through the performance of extensive numerical simulations. For concreteness, the numerical 
analysis reported here will focus on a simple scenario where the conditions required from our 
general model are satisfied in a specially transparent manner. Other alternative specifications 
consistent with the conditions posited in Sections ^ and || have been found to yield the same 
qualitative conclusions. 

Essentially, the two only components of the model which need to be specified pertain to 
the payoff function ip(-) and the update density </>(")• Concerning the payoff function, let it be 
given by: 

ip(a, a) = a — ki(l — exp(— [a — a],) — ^(l — exp(— [a' — a] , ) (8) 

for some k\, k^ > 0, where [x], = max{0,a;}. In terms of the general framework given by (||) 
and @, this amounts to making 

f(a) = a (9) 

iM _ ^). 1 _ 6XP( _ W+ , (10) 

This is obviously compatible with the required conditions - in particular, @) and @). Moreover, 
under suitable parameter conditions, (|9|)-(|l0|) turns the bilateral situation faced by every two 
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neighbors into a coordination game which, locally around an equilibrium, behaves like the well- 
known minimum-effort game - a context widely discussed in the evolutionary and experimental 
literature (recall the Introduction). Specifically, the game then displays the following local 
property: if two individuals with "marginally different" actions play the game, the one with 
the lower one obtains a higher payoff. To see this, note that if we consider two different actions, 
a and a', with 8 = a' — a > 0, the function h(-) defined by h(5) = ip(a',a) — tp(a,a') has the 
following derivative at 6 = : 

h'(0) = 1 - (fci - k 2 ). 

Thus, if k\ — k 2 > 1 (which is wholly within the range of interest to be considered below), we 
have ip(a' , a) — ip(a, a') < provided that a' is marginally larger than a. 

It is easy to check that the payoff function given in (|8|) guarantees that the diffusion dynam- 
ics satisfies (t)-(t) above. On the other hand, a further convenient feature following from this 
formulation is that the decision problem described in (|5]) has its optimal solution necessarily lie 
in the set {a\ +l {q — 1), a\{q — 1), a t i _ 1 (q — 1)}. That is, the optimal action must be one of those 
currently chosen in the neighborhood of the player in question. Obviously, this will facilitate 
matters in what follows by allowing us to handle the optimization problem faced by each agent 
in a especially simple manner. 

Finally, concerning the stochastic updates, we shall postulate that they are distributed 
uniformly and independently on [0, 1], i.e. 

tp(x) = i, Vxe[o,i]. (n) 

Much of our analysis will dwell on the effect of the incompatibility-cost parameters, k\ and 
k 2 , on the long-run evolution of the process. In fact, to understand the main issues involved, 
it turns out that only the difference k = k\ — k 2 needs to concern us. In view of (||), one 
can interpret k as the cost difference resulting from "downwards incompatibility" (i.e. being 
too advanced) as compared to that derived from "upwards incompatibility" (i.e. being too 
backwards). 

To gain a heuristic understanding of why this cost difference should be the key parameter, 
suppose that the system starts at a synchronized state at some t. That is, the previous state 
[a,i(t — l)]" = i satisfies aiit — 1) = a for some a and all i = 1,2, ...,n. Now suppose that the 
magnitude of the ensuing ith update is A and let i Q be the particular agent affected by it. We 
may then ask: When will this update again lead the system (once the corresponding diffusion 
phase has come to an end) into a new synchronized state at tl Of course, this will occur if the 
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payoff to any agent % 7^ i a of adopting a + A when at least one of his neighbors has done so is 
higher than if he were to remain at level a. Thus, if we focus on the only non-trivial case where 
one neighbor still adopts a, the relevant inequality is: 

2(a + A) - ki(l - e' A ) >2a- k 2 (l - e" A ), 

or equivalently: 

2A 

k = kx-k 2 <k*(A) = - E . (12) 

If (|l2|) holds, the update carried out by i will lead the system into a new synchronized state 
at the common level a + A, i.e. ai(t) = a + A for all i = 1,2, n. Otherwise, the update will 
introduce some "local heterogeneity" (i.e. asynchronization) around i a . 

In general, as A ranges from to 1 (i.e. the support of <r), the value for fc*(A) increases 
from limAj.0 &*(A) = 2 to fc*(l) = 3.164. Thus, in view of our preceding discussion, one may 
expect to find a transition from fully synchronized behavior (i.e. what physicists often call 
supercriticality) for k < 2 to increasingly more heterogenous behavior as k grows above this 
threshold. Indeed, such a transition will be clearly observed in our simulations, with sharply 
critical behavior (i.e. power laws) arising when k approaches the higher threshold given by 
fc*(l). 

Next, we discuss our numerical simulations in some detail. We shall focus in turn on the 
following issues: 

• long-run distributions for the sizes of the avalanches; 

• long-run distributions for the (technological) advances induced by avalanches; 

• long-run relationship between size and advance across different avalanches. 



4.1 Power laws 

We have obtained the (empirical) avalanche size distributions for different values of k and 
different values of n, the latter being considered in order to check for possible scale effects. The 
outcome of these simulations is summarized in Figures 1-2, where the relationship is depicted 
in doubly logarithmic scale.| 

6 Each point in the diagram gives the average log- frequency across all sizes in a corresponding interval. To 
identify graphically every such interval we take its mid-point (also in logarithmic scale). 
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Figure 1: Distribution of avalanche sizes, k = 2,3,3.5,4,6; n = 4096 - double logarithmic 
scale (log frequency versus log size). 




Figure 2: Distribution of avalanche sizes, k = 4; n = 1024, 2048, 4096, 8192, 16384, 32768 - 
double logarithmic scale (log frequency versus log size). 
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In Figure 1, we show the size distribution for different values of k and a fixed population 
size n = 4096. We can notice the transition from a regime (k < 2) where all avalanches are 
system-size wide to a regime (k > 3.5) where the avalanche size sharply obeys a power-law 
distribution. As this transition unfolds (e.g. around k = 3)|] one observes that avalanches of 
different sizes do occur, but they do not yet exhibit the clear-cut power-law regularities that 
are the hallmark of criticality. 

On the other hand, Figure 2 shows that the power-law relationship between size and fre- 
quency displayed for any given k in the critical region is independent of population size. For 
concreteness, this is shown for k = 4 and n spanning three orders of magnitude, but similar 
diagrams obtain for all k in the critical region and even wider ranges in population size. 

In Figure 3, we show that analogous conclusions are obtained for the empirical distribution 
of advances across different avalanches. This distribution also obeys a power law for values of 
k > 3.5, which is the (rough) threshold given before for critical behavior to start manifesting 
itself fully in terms of size distributions. This conclusion can be shown to be independent of 
population size, much as this was also shown to be the case in Figure 2 for avalanche size. 

The above results indicate that, as soon as downwards (relative) incompatibility costs be- 
come significant, avalanche size and avalanche advance both display a surprising regularity: the 
size- or advance-elasticity of the corresponding long-run frequencies are constant throughout. 
In physics, this phenomenon goes by the name of criticality, a term that points to the absence 
of characteristic scales, i.e. the lack of prominent (relative) scales at which the system behavior 
mainly takes place. 

Given the common qualitative features displayed by size and advance distributions, it is 
typically expected (see Jensen (1998)) that both magnitudes also display a power- like relation- 
ship between them. Indeed, this is confirmed by Figure 4, where we have plotted avalanche 
size versus associated average advance for different values of k in the critical region (k > 3.5). 

Figure 4 also points to an additional important feature of our simulation results: throughout 
the critical region, the elasticity of total average advance with respect to avalanche size (i.e. 
the slope in double logarithmic scale) is independent of k, remaining essentially constant to a 

value slightly above 1 (more precisely, at roughly 1.2). In contrast with previous observations 

7 For intermediate values of k £ (2, 3), the relationships between frequency and size is found to be increasing, 
thus reflecting a gradual approach to the situation where all avalances are of full system size as k decreases 
towards 2. Figure 1 only shows the results for k = 2, 3 in order not to complicate the diagram with the depiction 
of non-critical behavior in the transition phase. 
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Figure 3: Distribution of avalanche advance, k =3, 3.5, 4, 6; n=4096 - double logarithmic (log 
frequency versus log advance). 




Figure 4: Average advance versus avalanche size, double logarithmic scale fc=3.5, 4, 6, 9; 
n=4096. 
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(cf. Figures 1-3), note that such a constant elasticity is not simply a feature that prevails for 
given k but, rather, is a characteristic that holds uniformly across different (critical) values for 
k. The implications of this intriguing observation will be discussed below at some length. 

Finally, it is worth mentioning that critical behavior is gradually lost for very large values 
of k.f\ Specifically, as k —* do, any interaction between neighboring sites vanishes and one 
obtains a process of so-called random deposition, a well known process in the study of surface 
growth (cf. Barabasi & Stanley (1995)). As usual in these cases, the transition towards such 
a state of affairs involves an intermediate phase where the frequency decay is exponentially 
decreasing in avalanche size (i.e. it is much faster than the power decrease displayed in the 
critical region). For very large k, therefore, a disproportionate amount of avalanches are of 
very small size. Since this state of affairs displays few implications of interest for our purposes, 
we do not describe it here in any detail. 

To recapitulate, it is useful to provide a formal summary of the main power-law regularities 
observed in our simulations as follows. There are some thresholds A: and k defining the critical 
region (roughly, k = 3.5 and k = 30) such that if k < k < k: 

PI The long-run distribution of avalanche sizes s follows a power law of the form:[] 

P(s) ~ 1/s 7 (13) 

for some 7 > 0, dependent of k but independent of population size n. 

P2 The long-run distribution of total advances H follows a power law of the form: 

P(H) ~ 1/B p (14) 

for some (3 > 0, dependent of k but independent of n. 

P3 The relationship between avalanche sizes and corresponding advances follows: 

H ~ s a (15) 

where the exponent a > 1 is independent of k and n. 

The above conclusions indicate that, when k belongs to the critical region, the dynamic 
behavior of the system is in sharp contrast with that displayed by the customary approaches 

8 In our present context, the main distinguishing features of criticality start to fade away when k > 30. 
9 As standard, the symbol ~ signifies an asymptotic long-run equality between the two sides of the expression, 
modulo suitable constants. 
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to modelling social behavior in coordination setups. For example, in received models of evolu- 
tionary game theory (both when interaction is assumed local as well as global), a population 
facing a coordination game is almost always to be found "synchronized" (i.e. at an homogenous 
equilibrium). Instead, in our case, the heterogeneous waves (and corresponding advances) re- 
alized along the process will typically induce the rich diversity one often observes in real-world 
phenomena (e.g. concerning technological change). 

4.2 Criticality and long-run behavior 

In view of P1-P3, it is natural to conjecture that some macroscopic variables (e.g. certain 
population averages) might exhibit as well interesting long-run regularities. Indeed, this is 
confirmed in what follows concerning two interesting "summaries" of the limit behavior of the 
system. The first one is a simple measure of population heterogeneity, often called the width 
of the system. The second one captures a certain measure of its performance. We address each 
of them in turn. 

In problems of surface growth in physics, it is common to quantify the roughness of an 
interface (what in our case could be conceived as the heterogeneity of the technological profile) 
by its so-called width. Restricting attention to states reached once the diffusion process is 
complete, the width of the system after update t is defined by: 



Of course, the width of the system at any given point in time simply coincides with the standard 
deviation of the action levels. It is, therefore, a global statistic which would seem to abstract 
from the (local) spatial gradients that are the essential driving force of the model. Our interest 
in this magnitude, however, derives from the fact that when the system is critical, its width 
turns out to be closely related (i.e. is proportional, in a suitably extended fashion) to the 
spatial gradient functions - see Barabasi & Stanley (1995) for details. Thus, in this sense, the 
width of our critical system provides average "local" information and may be regarded as a 
convenient (indirect) measure of "technological roughness" for the induced profiles. 

Figures 5 and 6 below depict (again in doubly logarithmic scale) the time evolution of 
the width of the system, as defined in (|0|), for two different values of k in the critical region 




(16) 



where the overline denotes spatial average, i.e. 



a(t)* = - 5>*(t))«. 
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Figure 5: Time evolution of the system width, k = 4; n = 64, 128, 256, 512, 1024. - double 
logarithmic scale (log width versus log (updates) /n). 

and several population sizes (we have found the same qualitative behavior for other values 
of k in the critical region and larger population sizes). Since we are only interested in the 
statistical properties of the profile dynamics, the evolution of this magnitude is averaged over 
1000 independent runs,[^] the time periods reflecting the number of updates having materialized 
up to that point. 

The main conclusion to be derived from the above diagrams is that, within the critical 
region, there exists a well-defined long-run level of heterogeneity (technological diversity) on 
which the system tends to settle as the process evolves and "self-organizes" . This is another in- 
teresting long-run regularity that follows from critical behavior. It indicates that, even though 
avalanches of all sizes (and, therefore, profiles of very different roughness) are to be observed 
over time, the long-run level of heterogeneity (either locally or globally defined) grows mono- 
tonically, on average, to some well-defined magnitude. Naturally, this magnitude depends on 
the relevant parameters of the model, k and n. In this respect, the dependence on k is as one 
would expect: the larger is k, the larger is the long-run width and the slower (i.e. farther into 

the future) such a long-run level is attained. On the other hand, the dependence on n is equally 

10 Note that, of course, the interface roughness is not a smooth increasing function of time for each independent 
run! 
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Figure 6: Time evolution of the system width, k = 7; n = 64, 128, 256, 512, 1024. - double 
logarithmic scale (log. width versus log. (updates)/n). 

clear-cut but perhaps less intuitive: population size affects positively long-run width but has 
no implications on the speed at which it is attained. 

Now, we turn to what seems a richer and possibly more interesting implication of criticality. 
It concerns the relationship between criticality and some suitable measure of the performance 
of the system. To fix ideas, suppose that the parameter k of our model defines a family of 
"technological systems" (computer architecture, communication protocols, etc.) that display 
identical payoff possibilities but differ in their internal vertical compatibility. More specifically, 
assume that the payoff potential for each system grows along a common "performance ladder" 
that is applicable only when agents coordinate on the same action. On the other hand, per- 
taining to dis-coordinated situations, each system differs in the relative magnitudes of upward 
versus downward compatibility, as captured by their corresponding value of k in @. 

Suppose that the user population consists of individuals belonging to a certain organization 
(say, a big firm) and every adjustment involves a certain (arbitrary) cost c > that is indepen- 
dent on the extent of the change - for example, any adjustment might involve buying a new 
piece of equipment at a fixed cost. In this context, we may ask ourselves the following question: 
What is the cheapest way (i.e. cheapest technological system) by which the organization may 
eventually attain some pre-specified (average) technological level? Clearly, if the pre-specified 
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Figure 7: Time evolution of performance rate p for different values of k and n = 512. 



level is high enough, such a cost minimization is essentially equivalent to a maximization of 
the following magnitude: 



performance rate of the system. 

Consider now a related route to motivate the above measure of performance. Suppose 
that, within every time period, there is a fixed amount of resources that can be devoted to 
the upgrading the actions (technologies) of the population, each such adjustment (purchase 
of new equipment) still requiring some fixed cost c > 0. Furthermore, assume that there 
are always enough candidates for upgrades (either as "adjustment" or "updates"), but those 
that are geared towards matching a neighbor's action (diffusion) always enjoy higher priority 
than those that are not (i.e. updates). In this context, maximizing the long-run time rate of 
technological change is equivalent to maximizing p, as defined in (|i"7|). 

To facilitate the discussion, write p(T, k) and p{k) to reflect the dependence of p(T) and 
p on k. Several interesting conclusions concerning these magnitudes are obtained from our 
numerical simulations, as depicted in Figures 7 and 8. 



where H(t) and s(t) are defined by (||) and (fj]). For want of a better term, p will be called the 
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Figure 8: Long-run performance rate p for different values of k and n = 128, 512, 2048. 

Concerning Figure 7, the first observation one may readily make is that, for any given k, the 
long-run rate p(k) = limT^oo p(T, k) is a well-defined magnitude since p(T, k) is a (bounded) 
monotone function of T. This, however, does not entail any new information by itself, but is 
just an indirect confirmation that the avalanche and advance distributions display long-run 
distributions with well-defined averages. For, in view of (|l7|), note that the performance rate 
can be simply computed as the ratio of the average advance over the average avalanche size 
over a time path. 

There are, however, some additional and genuinely new observations arising from Figures 
7 and 8 that will underlie much of our ensuing discussion. For future reference, it is useful to 
organize them into the following two (partially overlapping) conclusions. 

CI The system's dynamic performance (as reflected by p) enjoys positive dependence on n 
only within (or very close to) the critical region - cf. Figure 8. This implies that, for 
large n, the performance rate p is optimized within (or very close to) the critical region. 

C2 The optimal value of k that maximizes p(k) is independent of n and is located at the 
"lower edge" of the critical region, i.e. in a narrow range around k = 3.5. 

By CI, significant scale effects (i.e. improvements in performance due to population in- 
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creases) are intimately associated to criticality, i.e. they only arise when, roughly, k € (3,30). 
On the other hand, C2 indicates that the performance of the system is maximized around the 
point where such criticality starts to set in. This latter conclusion may be interpreted along the 
lines put forward by some authors (e.g. Kauffman (1993)) who have argued that the dynamic 
response of large interacting systems is often optimized at the brink where heterogeneity and 
"disorder" (i.e. criticality in our case) just begin to manifest itself. 

The former considerations suggest that our analysis may be provided with some normative 
interpretation. Again, to be specific, suppose that k is a policy variable that determines the 
"technological system" to be applied in a certain organization (recall our former discussion). 
Then, if the underlying conditions are suitably approximated by the model (in particular, up- 
dates are infrequent relative to adjustment and the rate p is a relevant measure of performance), 
our results indicate that the optimal k is one that induces some "barely critical" amount of 
inter-agent heterogeneity. 

In a related vein, one may instead approach matters from an evolutionary viewpoint. Specif- 
ically, suppose that the underlying environment consists of a variety of different organizations 
that are characterized by alternative technological systems (i.e. idiosyncratic /c's), all of them 
initially co-existing as part of an heterogenous population. Then, our conclusions suggest that 
if evolutionary forces impinge on the population composition among different types of organi- 
zations (say, because of performance-related differences in survival or through social imitation), 
the long-run situation that should eventually prevail is one where organizations are placed at 
the edge of criticality. 

5 Theoretical analysis 

The entire simulation results reported in Section || refer to the numerical scenario given by (§) 
and (ITU) , which is a particular case of the general context defined by (|]) and Similar 
regularities (i.e., in particular, P1-P3 and C1-C2) arise in alternative scenarios consistent with 
these conditions. Given the vast complexity of the underlying process, it would have been very 
hard to establish those results by other than numerical methods. However, once established, 
we are now in a much better position to build partially upon them to aim at understanding 
their relationship analytically. 

Specifically, our theoretical approach will start by postulating P1-P3, i.e. it will assume 
that the system is critical for a certain parameter range. Then, based on this assumption, we 
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shall strive to derive analytically the conclusions C1-C2. Overall, this theoretical exercise will 
improve our understanding of the important relationship between criticality and the system's 
dynamic performance. 



Our first task is to provide an explicit expression for the performance rate p. For simplicity, 
we postulate that, for any given k > 0, the system is either in a critical, a supercritical, or a sub- 
critical regime. In practice, of course, there must be a gradual transition from supercriticality 
to criticality and then sub criticality as k grows in the range (0, oo). For our present analytical 
purposes, however, that range is assumed partitioned into three subregions by thresholds k 
and A;. Specifically, the interval (0,k) is taken to define the supercritical subregion, the interval 
(k,k) the critical subregion, and the remaining (k, oo) the subcritical one. 

The determination of p outside of the critical region is straightforward. On the one hand, 
when the system is supercritical (k < k), avalanches are system- wide (i.e. s = n) and hence p 
is equal to a = E(cr). On the other hand, in the subcritical region (k > k), all avalanches can 
be taken to be of (approximately) unit size and therefore the rate p is again equal to a. 

Now, consider the critical region where k < k < k. Denoting by P{H) and P{s) the 
corresponding discrete empirical densities, let 

r l T 

H ee J HP{H)dH=\im o -Y J H{t) 

s ee J s P(s) ds = li^- J2 s(t) 

define the long-run averages of H and s. Within the critical region, these densities are well- 
defined. Therefore, from (|l7|), we may compute the performance rate as follows: 

H-T H . . 

p=hm— r = ^. 18 

T^oo S ■ 1 S 

Then, we may rely on PI and P2 to conduct the following (approximate) derivations 



which is easily seen to lead to 



o 



Ji s s ^ds 



(19) 



7+1 n 2 -^ - 1 



Of course, this computation must be viewed only as an approximation conducted under the implicit as- 
sumption that the support of the conditional distributions P(H | s = s) displays a relatively narrow support - 
cf. Jensen (1998, p. 38). 
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Clearly, for large n, the above value for p is crucially dependent on the exponents of n (in 
particular, on whether they are positive or negative). In this respect, three different cases may 
be considered, with respective values for p that may be approximated (for large n) as follows:^] 



(i) If 7 < 2, 



2-7 



o-l. 



P 



a — 7 + 1 



n 



(ii) If 2 < 7 < a + 1 



7-2 



(a-l)-( 7 -2). 



a — 7 + 1 



n 



(iii) If 7 > a + 1 



7-2 



7 — a — 1 



By P1-P3, the parameters involved in the above expressions (in particular, 7 and a) can 
be taken to be independent of n, the population size. Therefore, for large systems (large n), 
it follows that the performance rate p(k) will be maximized somewhere in the critical region, 



"scale effects". Outside of it (that is, in either the supercritical or subcritical regions), the 
performance rate is (approximately) equal to a, independently of n. 

The previous considerations provide the basis for understanding CI. To understand C2, we 
now rely on P3, i.e. avalanche sizes and the induced advances are related through a power law 
that is not only independent of n but also holds unchanged for all k (of course, as long as k 
remains in the critical region). This key feature of critical behavior has the following striking 
implication: the effect of k on p becomes solely channelled through its effect on 7 (i.e. the 
steepness of the size distribution). Building upon this key observation, we are now in a position 
to understand why the maximization of p must indeed be achieved at the lower edge of the 
critical region. 

To this end, restrict attention to the critical region, and conceive p as a function of a and 
7, that is extended continuously from the interior of the different subregions (i)-(iii) for given 
n. Then, for small changes in k, we can symbolically write: 



Close to the borders between the different regimes, limits must be handled with care since divergencies 
pertaining vanishing terms occur and different limit operations do not commute. These technical issues notwith- 
standing, a detailed analysis of (jl9|) will convince the reader that p displays the properties later required (e.g. 
given n and a > 1, it induces a well-defined decreasing function of 7). 



i.e. for k € (k,k). For only in this region does the performance of the system benefit from 
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Ap A7 
~ A7 A A; 

since, by P3, we have 4f = (i.e. a is unaffected by k within the critical region). Now, it is 
easy to check from (|l9|) that ^ < 0. Combining this latter fact with ^ > (i.e. the weight 
of small avalanches grows with k), it follows that ^ < 0, i.e. p is a decreasing function of A;. 
Obviously, this implies that the maximization of p must occur at the lower boundary of the 
critical region. As desired, therefore, this provides an (approximate) analytical basis for those 
features of our numerical simulations which were stated in C2. 

In a sense, C2 may be interpreted as suggesting that optimal performance builds upon a 
rather delicate compromise between "order" (synchronization or homogeneity, i.e. supercriti- 
cality) and "disorder" (criticality). Heuristically, the underlying intuition for why some such 
balance should be expected to arise is not difficult to understand. On the one hand, if all 
individuals were to advance in step because of low incompatibility costs, individual adjust- 
ments would always be relatively small and no steep gradients could ever arise. Consequently, 
the overall pace of advance should be slow, individuals hardly taking advantage of the "scale 
economies" that a large system would avail. But, on the other hand, if incompatibility costs 
were large, the scale effects impinging on overall advance that could be potentially afforded by 
a large system would be, again, not fully taken advantage of. In this second case, avalanches 
would typically be too small for any heterogeneity to be profited by its required complement: 
an effective process of diffusion. 

The previous considerations provide quite a clear intuition for why optimal performance 
should require criticality, i.e. a suitable trade-off between homogeneity and heterogeneity in 
agents' unfolding behavior. What seems substantially more subtle is the additional sharper con- 
clusion that optimality is to be expected at the lower edge of the critical region. As explained, 
this appears to be intimately associated to the intriguing "empirical" (i.e. numerical) finding 
that criticality induces a fixed power relationship between avalanche sizes and the induced 
advances. 

6 Summary and Conclusion 

This paper represents a first step in a research project where we plan to study in detail the 
relationship among complexity, optimality, and self-organization in systems composed by a 
large number of locally interacting entities. As suggested above, many social and economic 
systems may be modelled in this fashion. In particular, this approach seems particularly well 
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suited to study technological evolution when the decisions adopted by the different entities 
(individual agents, firms, or even sectors) display local complementarities. 

In the context of a simple model with these features, we have seen that if dis-coordination 
costs exceed a certain threshold (but are not too large), the system self-organizes itself into a 
critical state and the sizes of diffusion waves are distributed according to a power law. In this 
case, moreover, the roughness of the population profile converges to a well-defined (average) 
magnitude, thus indicating that there is a specific degree of long-run population heterogeneity 
associated to each parameter (cost) configuration. In fact, it turns out that this "critical" 
heterogeneity plays a crucial role in the performance of the system. Specifically, we have 
seen that, given a natural measure of performance (that admits an interpretation of either 
average adoption cost or rate of technological advance), the system behaves optimally within 
the critical region - or, more precisely, at the lower edge of this region. This suggests that 
inter-agent heterogeneity plays a crucial role in the evolution of the system. In other words, 
either too "orderly" (synchronized) or too "chaotic" (dis-coordinated) dynamics is detrimental 
to performance in that it imposes too frequent (and thus costly) or too rare (and therefore 
unduly staggered) adjustment on agents' actions 

In ongoing research, we are studying a number of extensions of the present model. One 
of them concerns higher dimensional setups (specifically, a two-dimensional torus), where each 
individual has more than two neighbors and therefore the diffusion paths may exhibit richer 
geometries. A second extension involves studying irregular (but fixed)P| networks of the small- 
world variety (see Watts and Strogatz (1998)). In each of these contexts, the same qualitative 
conclusions found in the present model are essentially maintained. However, in the latter case 
(small- world networks), one obtains the expected result that, due to a relatively short expected 
path between any two agents, the parameter range where synchronous behavior tends to arise 
becomes significantly larger than in regular networks. 

This paper has shown that a quite simple model of social, but local-based, interaction may 
produce persistent and wide heterogeneity in the induced population dynamics. It is clear, 
however, that not all social networks can be expected to display such a behavior. For example, 
complete networks, which display no local structure, can only exhibit uninteresting "waves" 
in a coordination context analogous to that considered here. In such a context, fixed-size 
avalanches of the order of system size (and only those) would occur as the number of updates 

Note that, in order to preserve the key local structure of interaction that underlies our analysis, the network 
cannot change in an unrestricted (say, time-independent) fashion. 
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accumulated since the last avalanche come to exceed a certain threshold,^ 

Naturally, the above point raises the question of what networks might be conducive to 
critical behavior and, more importantly, whether such a class of criticality-supporting networks 
could arise endogenously when the social network is not fixed but may also co-evolve as dictated 
by agents' own decisions. The issue, in a sense, is analogous to that addressed by the most 
recent developments of evolutionary game theory that focus on how the parallel co-evolution 
of both players' links (or connections) and their actions may affect the received analysis on 
equilibrium selection.]^] Indeed, not only the concerns but also some of the techniques used in 
this literature (e.g. those employed to analyze perturbed Markov processes) would seem quite 
applicable to the problem at hand. The study of this important topic is left for future research. 

14 For simplicity, we are implicitly assuming every update to be of the same given magnitude. 

15 See, for example, Bala and Goyal (2000), Jackson and Watts (2000), or Goyal and Vega-Redondo (2000). 
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